Learning Convolutional Neural Network Research Articles

Evaluating Deep Learning Techniques for Detecting Aneurysmal Subarachnoid Hemorrhage: A Comparative Analysis of Convolutional Neural Network and Transfer Learning Models.

Machine learning (ML) and deep learning (DL) techniques offer a promising multidisciplinary solution for subarachnoid hemorrhage (SAH) detection. The novel transfer learning approach mitigates the time constraints associated with the traditional techniques and demonstrates a superior performance. This study aims to evaluate the effectiveness of convolutional neural networks (CNNs) and CNN-based transfer learning models in differentiating between aneurysmal subarachnoid hemorrhage (aSAH) and nonaneurysmal subarachnoid hemorrhage (naSAH). Data from Istanbul Ümraniye Training and Research Hospital, which included 15,600 DICOM images from 123 patients with aSAH and 7,793 images from 80 patients with naSAH, were used. The study employed four models: Inception-V3, EfficientNetB4, single-layer CNN, and three-layer CNN. Transfer learning models were customized by modifying the last three layers and using the Adam optimizer. The models were trained on Google Collaboratory and evaluated based on metrics such as F-score, precision, recall, and accuracy. EfficientNetB4 demonstrated the highest accuracy (99.92%), with a better F-score (99.82%), recall (99.92%), and precision (99.90%) than the other methods. The single- and three-layer CNNs and the transfer learning models produced comparable results. No overfitting was observed, and robust models were developed. CNN-based transfer learning models can accurately diagnose the etiology of SAH from CT images and is a valuable tool for clinicians. This approach could reduce the need for invasive procedures such as digital subtraction angiography, leading to more efficient medical resource utilization and improved patient outcomes.

Deep learning based event reconstruction for cyclotron radiation emission spectroscopy

The objective of the cyclotron radiation emission spectroscopy (CRES) technology is to build precise particle energy spectra. This is achieved by identifying the start frequencies of charged particle trajectories which, when exposed to an external magnetic field, leave semi-linear profiles (called tracks) in the time–frequency plane. Due to the need for excellent instrumental energy resolution in application, highly efficient and accurate track reconstruction methods are desired. Deep learning convolutional neural networks (CNNs) - particularly suited to deal with information-sparse data and which offer precise foreground localization—may be utilized to extract track properties from measured CRES signals (called events) with relative computational ease. In this work, we develop a novel machine learning based model which operates a CNN and a support vector machine in tandem to perform this reconstruction. A primary application of our method is shown on simulated CRES signals which mimic those of the Project 8 experiment—a novel effort to extract the unknown absolute neutrino mass value from a precise measurement of tritium β −-decay energy spectrum. When compared to a point-clustering based technique used as a baseline, we show a relative gain of 24.1% in event reconstruction efficiency and comparable performance in accuracy of track parameter reconstruction.

Medicinal Plant Identification using Machine Learning Algorithms

Medicinal Plant Identification using Machine Learning Algorithms

Enhancing Arabic Sign Language Recognition using Deep Learning

The present time, Sign language is very important for people who suffer from hearing loss or who cannot speak. Normal humans tend to disregard the significance of signal language, which is a mere supply of communique to mute and deaf societies. So, this study proposes a developed model for sign Language Recognition for Arabic using the Deep learning Convolutional Neural Network (CNN) algorithm. Then set the algorithm by developing programming on Open-CV, using Python language. The dataset contains 54049 snapshots of Arabic signal language alphabets. The 32 folders were created, and each one of them included 1500 images incorporating hand gestures in at-variance environments. The data set was divided into a training section with a percentage of 70 %, a section for testing with a percentage of 20 %, and a section for validation with a percentage of 10 %. The results show that the suggested model achieved an accuracy rate of 94.8%, and it has proven its effectiveness and success, especially after being tried and tested by several users and obtaining their comments and feedback.

Classification of Image using Convolutional Neural Network (CNN)

Abstract: Computer vision is concerned with the automatic extraction, analysis, and understanding of useful information from a single image or a sequence of images. We have used Convolutional Neural Networks (CNN) in automatic image classification systems. In most cases, we utilize the features from the top layer of the CNN for classification; however, those features may not contain enough useful information to predict an image correctly. In some cases, features from the lower layer carry more discriminative power than those from the top. Therefore, applying features from a specific layer only to classification seems to be a process that does not utilize learned CNN’s potential discriminant power to its full extent. Because of this property we are in need of fusion of features from multiple layers. We want to create a model with multiple layers that will be able to recognize and classify the images. We want to complete our model by using the concepts of Convolutional Neural Network and CIFAR-10 dataset. Moreover, we will show how MatConvNet can be used to implement our model with CPU training as well as less training time. The objective of our work is to learn and practically apply the concepts of Convolutional Neural Network.

DysDiTect: Dyslexia Identification Using CNN-Positional-LSTM-Attention Modeling with Chinese Dictation Task

Handwriting difficulty is a defining feature of Chinese developmental dyslexia (DD) due to the complex structure and dense information contained within compound characters. Despite previous attempts to use deep neural network models to extract handwriting features, the temporal property of writing characters in sequential order during dictation tasks has been neglected. By combining transfer learning of convolutional neural network (CNN) and positional encoding with the temporal-sequential encoding of long short-term memory (LSTM) and attention mechanism, we trained and tested the model with handwriting images of 100,000 Chinese characters from 1064 children in Grades 2–6 (DD = 483; Typically Developing [TD] = 581). Using handwriting features only, the best model reached 83.2% accuracy, 79.2% sensitivity, 86.4% specificity, and 91.2% AUC. With grade information, the best model achieved 85.0% classification accuracy, 83.3% sensitivity, 86.4% specificity, and 89.7% AUC. These findings suggest the potential of utilizing machine learning technology to identify children at risk for dyslexia at an early age.

Representational and sequential feature learning model for fault classification in power system

ABSTRACT The classification of three-phase faults in electrical power systems is essential. The vast majority of fault classification techniques are focused on machine learning framework that requires pre-processing algorithms and rely highly on feature engineering. In this paper, a hybrid Convolutional Neural Network and Long Short Term Memory (CNN-LSTM) deep learning model is designed and employed for fault classification. With this combination, both representational and sequential features are automatically extracted and effectively learned using lesser trainable parameters from the raw temporal data. The raw three-phase current and voltage data are used as input for the proposed model. The performance of the proposed model is tested using a 10-fold cross-validation technique on large simulated data produced from a standard IEEE 30-bus system. The efficacy of the proposed model is confirmed by comparing it with different standards and existing models from the literature. The impact of noisy data and load variation conditions are also studied and analysed on the model’s performance.

Image Colorization Using Deep Learning

mage colorization using deep learning is a fascinating field that aims to add color to black and white images automatically. This project explores the use of advanced neural networks, specifically convolutional neural networks (CNNs), to achieve this task efficiently and accurately. By leveraging large datasets of color images paired with their black and white counterparts, the CNN learns to predict plausible colorizations for grayscale input images. The project demonstrates the effectiveness of deep learning techniques in recreating realistic colors while preserving the details of the original images. Through experimentation and evaluation, we showcase the potential of this approach in various applications, including historical photo restoration, artistic expression, and enhancing visual content in multimedia. Overall, this project contributes to the advancement of computer vision and image processing technologies, offering a powerful tool for enriching visual content effortlessly. Keywords: Image Colorization, Deep Learning, Convolutional Neural Networks, Generative

Lesion attention guided neural network for contrast-enhanced mammography-based biomarker status prediction in breast cancer

Background and objectiveAccurate identification of molecular biomarker statuses is crucial in cancer diagnosis, treatment, and prognosis. Studies have demonstrated that medical images could be utilized for non-invasive prediction of biomarker statues. The biomarker status-associated features extracted from medical images are essential in developing medical image-based non-invasive prediction models. Contrast-enhanced mammography (CEM) is a promising imaging technique for breast cancer diagnosis. This study aims to develop a neural network-based method to extract biomarker-related image features from CEM images and evaluate the potential of CEM in non-invasive biomarker status prediction. MethodsAn end-to-end learning convolutional neural network with the whole breast images as inputs was proposed to extract CEM features for biomarker status prediction in breast cancer. The network focused on lesion regions and flexibly extracted image features from lesion and peri‑tumor regions by employing supervised learning with a smooth L1-based consistency constraint. An image-level weakly supervised segmentation network based on Vision Transformer with cross attention to contrast images of breasts with lesions against the contralateral breast images was developed for automatic lesion segmentation. Finally, prediction models were developed following further selection of significant features and the implementation of random forest-based classification. Results were reported using the area under the curve (AUC), accuracy, sensitivity, and specificity. ResultsA dataset from 1203 breast cancer patients was utilized to develop and evaluate the proposed method. Compared to the method without lesion attention and with only lesion regions as inputs, the proposed method performed better at biomarker status prediction. Specifically, it achieved an AUC of 0.71 (95 % confidence interval [CI]: 0.65, 0.77) for Ki-67 and 0.73 (95 % CI: 0.65, 0.80) for human epidermal growth factor receptor 2 (HER2). ConclusionsA lesion attention-guided neural network was proposed in this work to extract CEM image features for biomarker status prediction in breast cancer. The promising results demonstrated the potential of CEM in non-invasively predicting the biomarker statuses in breast cancer.

A Review On Early Detection Of Chronic Kidney Disease

Early detection of Chronic Kidney Disease (CKD) is critical for timely intervention and effective treatment. Deep learning algorithms have demonstrated promise in medical applications, including disease detection. In this study, we propose a deep learning-based system for early CKD detection using the Chronic Kidney Disease dataset from Kaggle. Additionally, we incorporate the Grasshopper Optimization Algorithm (GOA) for feature selection to enhance the system's performance and interpretability. Our system employs a convolutional neural network (CNN) architecture to analyze clinical and laboratory attributes from the CKD dataset, obtained from Kaggle, consisting of 4,000 instances with 25 attributes. These attributes encompass patient demographics, blood tests, and medical history, providing a comprehensive representation of CKD-related factors. To improve the system's performance, we integrate the GOA for feature selection. The GOA is a nature-inspired metaheuristic optimization algorithm that mimics the foraging behavior of grasshoppers. It aims to identify the most relevant attributes associated with CKD from the dataset. By selecting a subset of informative features, we enhance the model's predictive accuracy and reduce overfitting. During the training phase, the CNN learns to automatically extract relevant features and patterns associated with CKD from the selected attributes. Additionally, data preprocessing techniques such as normalization and feature scaling are applied to further improve the model's performance and generalizability. To evaluate the system's performance, we conduct experiments using a separate test dataset comprising 1,000 instances from the CKD dataset. The incorporation of the GOA for feature selection in our deep learning system not only improves its performance but also enhances interpretability. By identifying the most relevant attributes associated with CKD, we focus on key biomarkers and risk factors, enhancing the system's accuracy and providing valuable insights into the disease. Our research showcases the potential of deep learning algorithms, coupled with GOA-based feature selection, for early CKD detection. By leveraging the Kaggle CKD dataset and incorporating the GOA, we contribute to improving the accuracy and applicability of the system in real-world clinical settings. To handle Big data we are proposing to implement this problem on Pyspark one of the Big data computational environments for effective learning. In this platform, we can dynamically scale the infrastructure as per the demand of the data. Ultimately, our work aims to advance the early detection and management of CKD, leading to improved patient outcomes and more effective healthcare interventions.

Union is strength: the combination of radiomics features and 3D-deep learning in a sole model increases diagnostic accuracy in demented patients: a whole brain 18FDG PET-CT analysis.

FDG PET imaging plays a crucial role in the evaluation of demented patients by assessing regional cerebral glucose metabolism. In recent years, both radiomics and deep learning techniques have emerged as powerful tools for extracting valuable information from medical images. This article aims to provide a comparative analysis of radiomics features, 3D-deep learning convolutional neural network (CNN) and the fusion of them, in the evaluation of 18F-FDG PET whole brain images in patients with dementia and normal controls. 18F-FDG brain PET and clinical score were collected in 85 patients with dementia and 125 healthy controls (HC). Patients were assigned to various form of dementia on the basis of clinical evaluation, follow-up and voxels comparison with HC using a two-sample Student's t-test, to determine the regions of brain involved. Radiomics analysis was performed on the whole brain after normalization to an optimized template. After selection using the minimum redundancy maximum relevance method and Pearson's correlation coefficients, the features obtained were added to a neural network model to find the accuracy in classifying HC and demented patients. Forty subjects not included in the training were used to test the models. The results of the three models (radiomics, 3D-CNN, combined model) were compared with each other. Four radiomics features were selected. The sensitivity was 100% for the three models, but the specificity was higher with radiomics and combined one (100% vs. 85%). Moreover, the classification scores were significantly higher using the combined model in both normal and demented subjects. The combination of radiomics features and 3D-CNN in a single model, applied to the whole brain 18FDG PET study, increases the accuracy in demented patients.

Automatic Detection of Banana Maturity—Application of Image Recognition in Agricultural Production

With the development of machine vision technology, deep learning and image recognition technology has become a research focus for agricultural product non-destructive inspection. During the ripening process, banana appearance and nutrients clearly change, causing damage and unjustified economic loss. A high-efficiency banana ripeness recognition model was proposed based on a convolutional neural network and transfer learning. Banana photos at different ripening stages were collected as a dataset, and data augmentation was applied. Then, weights and parameters of four models trained on the original ImageNet dataset were loaded and fine-tuned to fit our banana dataset. To investigate the learning rate’s effect on model performance, fixed and updating learning rate strategies are analyzed. In addition, four CNN models, ResNet 34, ResNet 101, VGG 16, and VGG 19, are trained based on transfer learning. Results show that a slower learning rate causes the model to converge slowly, and the training loss function oscillates drastically. With different learning rate updating strategies, MultiStepLR performs the best and achieves a better accuracy of 98.8%. Among the four models, ResNet 101 performs the best with the highest accuracy of 99.2%. This research provides a direct effective model and reference for intelligent fruit classification.

Persian Traffic Sign Classification Using Convolutional Neural Network and Transfer Learning

Persian Traffic Sign Classification Using Convolutional Neural Network and Transfer Learning

Tumor Segmentation in Intraoperative Fluorescence Images Based on Transfer Learning and Convolutional Neural Networks.

To propose a transfer learning based method of tumor segmentation in intraoperative fluorescence images, which will assist surgeons to efficiently and accurately identify the boundary of tumors of interest. We employed transfer learning and deep convolutional neural networks (DCNNs) for tumor segmentation. Specifically, we first pre-trained four networks on the ImageNet dataset to extract low-level features. Subsequently, we fine-tuned these networks on two fluorescence image datasets (ABFM and DTHP) separately to enhance the segmentation performance of fluorescence images. Finally, we tested the trained models on the DTHL dataset. The performance of this approach was compared and evaluated against DCNNs trained end-to-end and the traditional level-set method. The transfer learning-based UNet++ model achieved high segmentation accuracies of 82.17% on the ABFM dataset, 95.61% on the DTHP dataset, and 85.49% on the DTHL test set. For the DTHP dataset, the pre-trained Deeplab v3 + network performed exceptionally well, with a segmentation accuracy of 96.48%. Furthermore, all models achieved segmentation accuracies of over 90% when dealing with the DTHP dataset. To the best of our knowledge, this study explores tumor segmentation on intraoperative fluorescent images for the first time. The results show that compared to traditional methods, deep learning has significant advantages in improving segmentation performance. Transfer learning enables deep learning models to perform better on small-sample fluorescence image data compared to end-to-end training. This discovery provides strong support for surgeons to obtain more reliable and accurate image segmentation results during surgery.

Forward layer-wise learning of convolutional neural networks through separation index maximizing

This paper proposes a forward layer-wise learning algorithm for CNNs in classification problems. The algorithm utilizes the Separation Index (SI) as a supervised complexity measure to evaluate and train each layer in a forward manner. The proposed method explains that gradually increasing the SI through layers reduces the input data’s uncertainties and disturbances, achieving a better feature space representation. Hence, by approximating the SI with a variant of local triplet loss at each layer, a gradient-based learning algorithm is suggested to maximize it. Inspired by the NGRAD (Neural Gradient Representation by Activity Differences) hypothesis, the proposed algorithm operates in a forward manner without explicit error information from the last layer. The algorithm’s performance is evaluated on image classification tasks using VGG16, VGG19, AlexNet, and LeNet architectures with CIFAR-10, CIFAR-100, Raabin-WBC, and Fashion-MNIST datasets. Additionally, the experiments are applied to text classification tasks using the DBPedia and AG’s News datasets. The results demonstrate that the proposed layer-wise learning algorithm outperforms state-of-the-art methods in accuracy and time complexity.

Modified Adaptive CNN for Deep Learning based Histopathological Image Analysis for Cancer Diagnosis

This research on cancer diagnosis is motivated by the need for more accurate and efficient diagnostic tools in the field of oncology. Traditional methods of histopathological examination are time-consuming and can be subject to human error. The adoption of deep learning techniques, particularly Convolutional Neural Networks (CNNs), presents an opportunity to significantly improve the precision and speed of cancer diagnosis through automated analysis of tissue samples. This research addresses current challenges, including variability in samples and limited dataset diversity, with the goal of enhancing the reliability and applicability of the developed models. The ultimate aim is to contribute to the advancement of diagnostic methodologies, providing clinicians with more reliable tools for early and accurate cancer detection and ultimately improving patient outcomes and treatment strategies. Using a modified adaptive CNN algorithm, trained on extensive pathology image datasets, the approach enhances the precision and speed of cancer cell detection in tissue samples. By utilizing these artificial intelligence tools, the diagnostic process becomes not only more accurate but also significantly expeditious. Despite the promising strides, certain challenges persist. Variability in tissue samples, limited availability of diverse datasets, and interpretability of deep learning models pose hurdles to widespread adoption. To address these challenges, this research focuses on developing robust models that can generalize well across diverse datasets. Additionally, efforts are being made to create more comprehensive and diverse datasets to improve model training. Results show accuracy exceeding 97%, sensitivity and specificity at 97% and 95%, F1 score reaching 96%, and precision at 96%.

Modified Adaptive CNN for Deep Learning based Histopathological Image Analysis for Cancer Diagnosis

This research on cancer diagnosis is motivated by the need for more accurate and efficient diagnostic tools in the field of oncology. Traditional methods of histopathological examination are time-consuming and can be subject to human error. The adoption of deep learning techniques, particularly Convolutional Neural Networks (CNNs), presents an opportunity to significantly improve the precision and speed of cancer diagnosis through automated analysis of tissue samples. This research addresses current challenges, including variability in samples and limited dataset diversity, with the goal of enhancing the reliability and applicability of the developed models. The ultimate aim is to contribute to the advancement of diagnostic methodologies, providing clinicians with more reliable tools for early and accurate cancer detection and ultimately improving patient outcomes and treatment strategies. Using a modified adaptive CNN algorithm, trained on extensive pathology image datasets, the approach enhances the precision and speed of cancer cell detection in tissue samples. By utilizing these artificial intelligence tools, the diagnostic process becomes not only more accurate but also significantly expeditious. Despite the promising strides, certain challenges persist. Variability in tissue samples, limited availability of diverse datasets, and interpretability of deep learning models pose hurdles to widespread adoption. To address these challenges, this research focuses on developing robust models that can generalize well across diverse datasets. Additionally, efforts are being made to create more comprehensive and diverse datasets to improve model training. Results show accuracy exceeding 97%, sensitivity and specificity at 97% and 95%, F1 score reaching 96%, and precision at 96%.

IOT based Waste Segregation Using Deep Learning

In the rapidly urbanizing world, effective waste management is crucial to maintain environmental sustainability. This project presents an innovative solution utilizing Internet of Things (IoT) technology and deep learning Convolutional Neural Networks (CNN) algorithm for automated waste segregation. We propose a smart waste segregation system equipped with sensors to detect the level of waste in bins. The system utilizes a CNN model trained using Deep Learning to classify waste items into different categories, ensuring proper segregation. When a bin reaches its full capacity, the IoT sensors trigger an alert mechanism, sending real-time notifications to the concerned authorities or waste management personnel. This proactive approach not only optimizes waste collection but also promotes recycling by ensuring the segregated waste reaches the appropriate recycling facilities. The integration of IoT devices and deep learning algorithms enhances the efficiency of waste management processes, reducing environmental pollution and promoting a sustainable future. Key Words: IoT, waste management, deep learning, CNN algorithm, waste segregation, environmental sustainability, real-time monitoring, sensor technology, recycling, smart cities, automation.

Splitting and parallelizing of quantum convolutional neural networks for learning translationally symmetric data

Splitting and parallelizing of quantum convolutional neural networks for learning translationally symmetric data

Fault Diagnosis of Drone Motors Driven by Current Signal Data with Few Samples

Abstract Multirotor UAVs find extensive application across diverse domains, with their motors serving as pivotal components in the UAV power system. The majority of UAV failures and crashes stem from motor malfunctions, underscoring the critical need for research in UAV motor fault diag-nosis. This paper focuses on quadrotor UAVs employing DC brushless motors as the research subject. The study designs fault experiments for three key components—stator, rotor, and bear-ing—based on the structural and operational characteristics of these motors. Addressing chal-lenges such as limited installation space for UAV payloads and redundant components, difficul-ties in sensor installation, high costs, and data acquisition complexities, this research adopts the current signal as the diagnostic signal. It explores a UAV motor fault diagnostic method based on the current signal. Furthermore, the study investigates a motor fault diagnosis method based on the current signal. To overcome challenges arising from the UAV's heightened sensitivity to the health of its components and the limited availability of fault data training samples, traditional machine learning and deep learning methods face difficulties in identifying representative fea-tures under small samples, often succumbing to overfitting risks and resulting in low diagnostic accuracy. To address these issues, a hybrid neural network fault diagnosis model is proposed, integrating the width learning system and convolutional neural network. The width learning system maps the original current signal into a feature space, yielding more robust and repre-sentative sample features. Subsequently, the convolutional neural network undertakes feature extraction and classification tasks. In experiments focused on current signal data-driven small-sample fault diagnosis in UAV motors, the proposed model outperforms other models used for comparison.